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Description 

Field Of The Invention 

This Invention relates to a computer system and, 
more particularly, to a lock out avoidance mechanism 
used in the computer system to prevent a situation 
wherein lock requests generated by the system devices 
are never serviced by the system. 

Baclcground of The Invention 

In multiprocessor systems, any of a number of proc- 
essors or devices may desire exclusive access to a 
shared resource in the system. These shared resources 
can be, for example, a memory location such as a block 
of memory, longv/ord, byte, etc. In order to obtain exclu- 
sive rights to the memory location, the processor gen- 
erates an interlock signal in the form of a lock request 
which will lock that particular location in memory to a 
device requesting access and thus deny any other proc- 
essor or device interlocked access to the particular 
memory location. Once the processor finishes with the 
particular memory location, an unlock request is gener- 
ated to unkxk the location, thus again allowing general 
access. 

The use of kx:k requests occurs most often when 
processors share a resource such as a particular data 
structure or table stored in the memory. In order to gain 
access to such shared resource, the processors syn- 
chronize using interlocked operation In memory loca- 
tions sometimes referred to as semaphores. Because 
only one processor is granted exclusive access to the 
semaphore any operations on the shared resource is 
thus serialized. It is possible that multiple processors 
wishing to access the resource simultaneously may 
generate lock requests for the semaphore. For example, 
if a system includes four processors (CPUs) or nodes 
from which bck requests can originate, it is possible for 
two or more processors to desire interlocked access to 
the same location at the same time. In this Instance, one 
of the requests is refused and the refused node receives 
a retry signal Instructing it to retry the kx:k request. Typ- 
ically, each of the CPUs or the memory itself must keep 
track of the locked memory locations, status of any 
pending lock requests, etc. In other systems using a 
central arbiter to receive the lock requests, the tracking 
of the lock requests occurs at the central arbiter In either 
system it is possible, when multiple nodes require 
locked access to the same memory location, for one or 
more nodes to be denied access forever This condition 
is referred to as lockout. 

Further, many systems include several levels of 
processing, with each level having multiple sources 
which can generate lock requests. Therefore, k)ck out 
may occur at any level in the system wherein multiple 
lock requests are generated. In previous system de- 
signs the lock out condition was resolved either by throt- 



tling all requestors except the node locked out when this 
condition was detected by the system or by forcing 
queuing of all locked requests which enforced sequen- 
tiality. This resulted in either a complex lockout avoid- 
s ance protocol or slowed the system performance with 
respect to lock requests. 

Summary of the Invention 

10 Prior art publication by Kelter in Information Sys- 
tems, vol. 14, no. 2. 1989, Dortmund, Germany, pages 
1 75 to 1 80. titled "Deadlock-Freedom of Large Transac- 
tions in Object Management Systems", teaches how to 
prevent deadlocks between large transactions in object 

IS management systems. In object management systems, 
deadlocks cause undesirable consequences and 
should be avoided. To this end, a technique called pseu- 
do preclaiming is used. A queue protocol taught in the 
prior art publication allows granting of locks without de- 

20 lay on unlocked objects. Pseudo preclaiming protocol 
taught by this prior art arrangement guarantees that 
transactions whk;h do not claim further objects will not 
run into deadlocks. 

The invention, In its broad form, resides In a method 

25 for avoiding lockout of lock requests from a plurality of 
nodes to share a common resource, and a lockout 
avoidance circuit, as recited respectively in claims 1 and 
5. 

The present invention overcomes the prior art prob- 

30 lams by providing an efficient and simple hierarchical 
system of lock out avoidance mechanisms for use in 
systems having central locations for receiving the kx:k 
requests. To avoid lock out, each of the mechanisms us- 
es a centralized queuing structure called a lock queue. 

35 The centralized queuing mechanism Is used because 
all interlock signals, e.g., lock requests and unlock re- 
quests, are received at this central location. The kxk 
queue contains as many entries as there are possible 
nodes from which lock requests can originate, but no 

40 one entry is specifically tied to any node. Each entry in 
the lock queue contains a valid indication field and a 
node identification (I.D.) field. The valid indication field 
indicates whether the lock request is valid and the node 
I.D. field stores the identification of the node generating 

45 the lock request. The lock queue further has a head and 
a tail entry. The head points to the first entry, i.e., the 
highest priority entry, in the queue and the tail points to 
the first available entry in the lock queue. Each time the 
head of the queue is serviced, i.e.. its lock request is 

so satisfied, the head of the queue moves to the next entry 
in line. If one of the nodes already has an entry in the 
queue which has not yet been serviced, then subse- 
q'jcnt Icck rcquoctc from that node will be written into 
the same place in the lock queue. This is possible be- 

55 cause the entries only contain the node I.D. and not the 
request Itself. In this manner, the lock queue need only 
contain a number of entries corresponding to the 
number of nodes from which lock requests can origt- 
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nate. 

The lock queue is usually empty and lock requests, 
from the various nodes passing through the central lo- 
cation, only enter the lock queue, if. after a predeter- 
mined number of tries, they are unable to gain access s 
to a particular resource. For example, assume that a 
lock request from node 0 is refused access because the 
particular memory location was already locked or a reg- 
ister for allowing the lock request was not available, then 
the central location increments a refusal counter for the 
particular node. When the node, in this case node 0, re- 
tries its lock request, it will then again be either refused 
or granted access. If the lock request is refused a pre- 
determined consecutive number of times while the lock 
queue is empty, then the node's I.D. will be stored at the 
head of the lock queue along with an indication of its 
validity. 

Because the lock queue is no longer empty, any 
subsequent lock requests from any other node in the 
system wilt be refused access to any location and will 
immediately enter the lock queue in the order in which 
they are serviced by the central location. When a lock 
request at the head of the queue is serviced, then the 
next waiting request in the queue becomes the head of 
the queue. 

In this manner, a lock out avoidance mechanism is 
operated such that if the lock queue is empty, it is difficult 
to enter the lock queue because a particular lock request 
must be refused the predetermined number of times be- 
fore the lock request may enter the queue. Once in the 
queue, the lock requests are serviced serially which 
slows down the system. Therefore, the lock queue is op- 
erated to try to keep the queue empty by using the re- 
fusal counter. This operation ensures that the queue is 
usually empty. However, once the lock queue is no long- 
er empty, all future lock requests are serviced strictly by 
their queue positk)n. This operat'ion continues until the 
lock queue again becomes empty. Thus, the lock out 
avoidance mechanism at this level guarantees that each 
node will eventually have its lock request sen/iced. 

The present invention provides a similar lock out 
avoidance scheme at each level in the system wherein 
a \ook out condition can occur. For example, a typical 
multiprocessor system has a number of hierarchical lev* 
els. A first level has each of the processors in the system 
vying for access to the system bus. The second level 
has devices within each processor, such as a processor 
chip and an interface chip, vying for access to the proc- 
essor's bus. Further levels can include devices coupling 
through the interface chip which try to access the inter- 
face bus, etc. 

Assuming in our second level that for each proces- 
sor of a multiprocessor system, there are two sources 
of lock requests, i.e., the processor chip itself and other 
devices interfacing therewith, then the lock out avoid- 
ance mechanism at this level consists of a two entry 
queue. Each entry in the queue contains two fields: 1) 
an entry valid and 2) source I.D. As long as the lock re- 



quests are not refused, the queue will remain empty 
However, if a lock request from, for example, the proc- 
essor chip is refused, then that lock request immediately 
enters the head of the queue. From that point onward 
until the request is granted, only the processor chip's 
lock requests can be output onto a bus to the central 
location. If another device generates a lock request at 
the second level, the lock request enters the queue be- 
hind the processor chip's entry and is internally refused 
by the processor. When the head of the queue's lock 
request is eventually satisfied, i.e., the processor chip 
is finally granted access, the entry is popped from the 
queue and the next device becomes the head of the 
queue. Thus, a lock out avoidance mechanism is pro- 
vided at a second level in the system. 

As a result of providing a lock out avoidance mech- 
anism at each level wherein multiple sources can gen- 
erate lock requests and hence lock outs could occur, the 
present invention guarantees that every kxk request 
generated in the system will eventually be serviced. 

Brief Description Of The Drawings 

Figure 1 is a block diagram of a system advanta- 
geously employing the present invention. 

Figure 2 is a block diagram of the central arbiter in- 
cluding the lock logic of the present invention. 

Figure 3 is a block diagram of one of the CPU mod- 
ules in Figure 1. 

Figure 4 is a detailed block diagram of the lock logic 
of the present Invention. 

Figure 4a is a block diagram of a lock register entry. 

Figure 4b is a diagram of an entry in the lock queue. 

Figure 5 is a diagram of the kxk queue at the proc- 
essor level in the system of Figure 1 . 

Detailed Description 

System Overview 

Fig. 1 is a block diagram of a system which advan- 
tageously uses the present invention. As illustrated, 
there are four CPU's 0-3 indk:ated as blocks 11-14, re- 
spectively. These blocks 11-14 are coupled to a central 
unit, indicated by dashed line 15, to be described in 
more detail below. Each of the CPUs 11 -1 4 is connected 
to the central unit 1 5 over a point to point bus, hereinafter 
referred to as an E-BUS TA, the E-BUS TA for CPU 0 
being designated as 17, the corresponding bus for CPU 
1 as 18, and so on accordingly. Each CPU 11-14 also 
receives output on an E-BUS FA from the central unit 
15, the four buses being designated respectively as 21 
through 24. A)-- ^^--wn in the illustrated embodiment, 
each of the CPUs 11-14 communicates with a bus adap- 
tor XJA 25 over two 16-bit buses, i.e., an input and an 
output bus, with the bus adaptor 25 converting this in- 
formation to another bus 27. A console 26 is associated 
with at least one of the CPUs 11-14. 
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The system also includes a shared memory made 
up of a plurality of memory modules 31a to 31 n which 
are coupled to the central unit 1 5 over what is designat- 
ed A-BUS FA 33 and what Is designated as A-BUS TA 
35. The A-BUS FA 33 carries outputs from the central s 
unit 1 5 to the memory modules and the bus 35 provides 
memory information to the central unit 15. In the illus- 
trated embodiment, buses 17-24 and 33 are 32 -bit par- 
allel buses and bus 35 is a 64-bit parallel bus. The E- 
BUSES operate at 6ns timing and the A-BUSES at 1 6ns io 
in this embodiment. 

Fig. 1 further shows a configuration for the central 
unit 1 5. A multiplexer, designated generally by 37. is pro- 
vided in the central unit 15. As will be shown below, the 
multiplexer 37 is made up of several multiplexers ad- is 
vantageously coupled together. At the inputs to the mul- 
tiplexer 37 is a port logic block 49 composed of port logic 
units 49a. Each port logic unit 49a includes a buffer 53 
for each Input port, i.e., each E-BUS TA 17-20. Each of 
the buffers 53 in the port logic units 49a can hold three 
words for each of buses 17-20 from CPUs 11-14. Out- 
puts from the buffers 53 are coupled into scheduler ar- 
bitrator logic 50 which arbitration logic 50 provides out- 
puts to control multiplexer 37. One of the general out- 
puts of MUX 37 Is fed to a write buffer 10 which is cou- 25 
pled to memory modules 31a-n via the bus 33. 

Fig. 2 Is a more detailed block diagram of the central 
unit 15 of Fig. 1 showing a port select logic 65 and re- 
source check 67 which together compose the schedul- 
er/arbitrator 50 of Fig. 1 and its relatbnship to other el- 30 
ements of the system. Port select logic 65 is combined 
with multiplexer 37a to form scheduling logic 66. Re- 
source check logic 67 combines with MUX 37b and state 
device 42 to form arlsitrator 51. As illustrated, the buses 
17-20 are Inputs to the port logic 49. Each CPU is con- 3S 
sidered a system port, individual port logic units, desig- 
nated 49a-d, are provkJed for each of the buses 17-20. 
The bus information enters a state device 53a, forming 
part of the buffer 53 of Fig. 1 , from which it Is directed 
to buffer 53b, also forming part of buffer 53 in Fig. 1 . The 40 
buffer 53b has storage space for three words. The out- 
put from the state device 53a is also provided into va- 
lidity logic 57. The validity logic 57 controls a port mul- 
tiplexer 59. The validity logic 57 also receives a port 
grant signal on line 61 from the arbitrator 51 . Validity log- , 45 
ic 57 determines whether or not a command or data are 
valW and which of the data, either in the buffers 53b or 
on the input line from the state device 53a, is to be 
switched out onto an output line 63 which provides one 
of the inputs to a multiplexer 37a (part of MUX 37 in Fig. so 
1). The outputs on lines 63 from the port multiplexers 59 
are the inputs to the multiplexer 37a Associated with 
the multiplexer 37a is port selectbn or scheduling logic 
65. In response to outputs from the arbitrator 51 , and its 
own logic, the port select logic 65 selects on e of the four ss 
input lines 63 to be coupled to the output of multiplexer 
37a. This, of course, must be coordinated with the op- 
eration of the logic 57 which is switching outputs onto 



the lines 63. The port select logic 65 basically operates 
so as to provide the four ports providing their inputs on 
line 63 a round robin access to bus 36. 

Bus 36 is an input to a resource check block 67 
which is part of the arbitrator 51 . Bus 36 is also an input 
to the multiplexer 37b (also part of MUX 37 in Fig. 1). 
Bus 36 Is also coupled to a memory map unit ("MMAP") 
69. lock logic unit ("LOCK") 71, input/output unit 
("CPIO") 73. interrupt request unit ("IREQ/SNIT") 75. 
memory controller ("MEMC/DBEC") 77 and memory 
write data path unit ("MWDP") 79. Each of the blocks 
69, 71, 73. 75 and 77 also provide inputs to the mutli- 
plexer 37b. In addition, the resource check 67 can pro- 
vide an ARB command to the multiplexer 37b. 

The previously described A-BUS TA is provided as 
an Input to a memory read data path 81 which provides 
its input into the memory controller, i.e., the MEMC/DE- 
BC 77, the output of which is the memory controller refill 
data which is one of the inputs to multiplexer 37b. An 
output of MEMC/DBEC 77 is also provided onto the line 
33, i.e., the A-BUS FA line. The output from the multi- 
plexer 37b Is provided through a state device 42. The 
output of state device 42 forms the E-BUS FA buses that 
couple to all the CPUs. 

Each of the blocks 69, 71 , 73. 75. 77 and 79 provide 
an input to the resource check 67 which utilizes this in- 
formation and the presence of a command on the bus 
36 to arbitrate between the different inputs which want 
access to the multiplexer 37b. It grants access via its 
output lines coupled through state devices 67a and 67b. 
One set of output lines is the output lines 83 leading from 
the resource check 67 to each of the blocks 69, 71 , 73, 
75, 77 and 79. The other are the lines 61 and 85 leading, 
respectively, to the port logic 49 and the port select logic 
65. 

Fig. 3 is a more detailed block diagram of one of the 
CPU nrKxJules 11-14 (in this case CPU 0) shown In Fig. 
1 . The CPU module 1 1 has three major component chips 
including an interface (X) chip 102, a processor (P) chip 
104 and cache interface (CF) chip 100. The processing 
chip or P chip 104 is coupled with a cache memory 106. 
The processing chip 104 further couples with a cache 
tag store 110 by which it requests an address over line 
1 1 2 and receives a tag entry via line 1 1 4. The P chip 1 04 
makes use of lines 116 to enable data to be written to 
the cache memory 106. Further, lines 118 provide the 
data and error correction codes (ECC) from the cache 
memory 106 to the processing chip 104. 

The cache memory 1 06 is shown in this example 
composed of random access memories (RAMs). The 
cache 106 further receives data and ECC information 
from the CF chip 100 over lines 1 20. The operation of a 
cache memory*. 106 along v/ith its acsociatcd cache tag 
store 1 1 0 is well known to those skilled in the art and will 
not therefore be discussed. 

The X chip 1 02 provides an interface to the XJA bus 
adaptor 25 (Fig. 1 ). The X chip 102 provides outputs to 
the CF chip 100 and receives inputs therefrom. Further, 
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the X chip 102 interfaces with a console support block 
108 for interfacing with a console terminal 26 (Fig. 1). 

The CF chip 100 provides outputs to the cache tag 
store 110 including new tag entry and write enable in- 
formation. Further, the CF chip 100 receives address 
and data operands, along with parity information, from 
the processing chip 104. The CF chip 100 couples the 
CPU with the E BUS TA and E BUS FA as indicated by 
bus lines 17 and 21, respectively. 

Interlock Queueing 

Referring back to Fig. 1, it is often desirable for 
some device such as one of the CPU modules 0-3 or an 
I/O unit or device through the XJA adaptor to gain ex- 
clusive access to a particular unit or location of the mem- 
ories 31a-31n. For example, one of the CPU modules 
11-14 may desire to lock a block of data, a longword, a 
byte, etc.. in one of the memory modules 31a-31n. To 
do so. the device generates a lock request in the form 
of a READ LOCK command. This command will lock the 
particular memory location altowing the resource exclu- 
sive access thereto. Once the location is locked no other 
CPU's lock request to that location will be allowed. Once 
the resource has completed its operations on the loca- 
tion» a WRITE UNLOCK command is generated to free 
the memory location. The precise operation of these 
commands is described below with respect to Figure 4. 

In the example of Fig. 1 , there are four E BUS 
nodes, corresponding to CPU modules 0-3, from which 
lock requests can originate. Still further, as seen from 
Fig. 3, each node on the E BUS. in this case the CPUs, 
also includes more than one resource which may gen- 
erate lock requests, for example, the P chip 104 or the 
X chip 102. In this instance, the CF chip 100 functions 
to insure that neither the processing cliip's 104 or X 
chip's 1 02 bck requests are kxked out from being sen/- 
iced. Similarly, the central unit 15 must insure that no 
lock out occurs for any of the nodes on the E BUS. 

Referring to Fig. 2, the central unit 15 makes use of 
lock block 71 which includes lock logic to be described 
below in Fig. 4, to insure that no node is ever kxked out 
from having its lock request satisfied. Further, the CF 
chip 100 in the CPU shown in Fig. 3 includes kx:k logic 
1 25 for insuring that neither the CPU nor the X chip are 
ever locked out from having their lock requests satisfied. 
In this manner as will be fully described below, a hierar- 
chy of lock out avoidance mechanisms, i.e., kx;k bgic 
71 and lock logic 125, are utilized to insure that every 
lock request is eventually serviced. 

Referring to Fig. 2, lockout avoidance is performed 
at the highest level by the lock logic 71 in the central unit 
•-■M- .-fl o.->aL. t5«The use of the central unit 15 to keep track of lock 
locations and to avoid lockouts provides an advantage 
over conventional multi-drop buses wherein each CPU 
or memory coupled to the bus must keep track of the 
locked data. Because the central unit 15 receives al Mock 
requests and maintains lock registers, it provides the op- 



portunity to implement centralized queueing mecha- 
nisms to avoid the lockouts. 

Fig. 4 describes in greater detail the lock logic 71, 
The lock logic 71 includes a predetermined number of 

s kxk registers 80a-80n, in the example shown 'n" equals 
eight, but it is understood to depend upon the require- 
ments of the system. Each of the lock registers 80a-80n 
stores the address of a particular memory location to be 
kx:ked. For this example having eight lock registers, up 

10 to eight memory locations can be locked at any given 
time. The outputs from each of the register blocks 80a- 
80n are the result of a compare performed between 
each of the lock registers and the address of an incom- 
ing lock request on bus 36. The output of OR gate 82 

15 provides either a LOCK HIT or LOCK fwlISS signal. The 
LOCK HIT signal is provided to further logic 84 which 
outputs a LOCK REFUSED signal to the resource check 
67 in the arbiter 51 (Fig. 2). The LOCK MISS signal is 
provided as an input to a write control 86. 

20 Each kxk register SOa-dOn includes a register 88 
and a comparator 90. The register 88 stores an address 
of the memory location desired to be locked along with 
an indication of its validity, i.e., locked or unlocked, as 
shown in Fig, 4a, The register 88 is composed of several 

25 fields including a lock register valid bit field, node source 
ID, and byte addresses. The register 88 is enabled via 
commands from the write control block 86. 

The command and address received from the 
schedule logic 66 (Fig. 2) over bus 36 is provided in par- 

30 allel to the comparators 90 in each of the lock registers 
80a-80n. The command and address are further provki- 
ed to delay logic 92 which has an output coupled in par- 
allel to the registers 88 in each of the kx:k registers 80a- 
80n. The output from the registers 88 are provided as 

35 another input to the comparators 90 in each of the lock 
registers. The output from the comparators 90 in each 
of the lock registers is then provided to the OR gate 82 
mentioned above. 

A lock queue, shown generally by dotted line 130, 

40 is composed of several state devices 94a-94d chained 
together. The number of entries in the lock queue (in this 
example four) correspond to the number of nodes. An 
example of one of the state devices 94a-94d is shown 
in greater detail in Fig. 4b functioning as a lock queue 

45 register entry including a lock queue register valid bit 
and node source ID bits. Coupled with each state device 
94a-94d is an associated multiplexer 96a-96d. The reg- 
isters 94a-94d and multiplexers 96a-96d are coupled to- 
gether to form the lock queue 1 30 which f unctbns as 

so will be described below. A comparator 98a-98d is asso- 
ciated with each individual state device and multiplexer 
94, 96 and receives an input therefrom. Further, the 
comparator 98 recei^/oaar. input torn the ccmrrand ad- 
dress bus 36. Each of the comparators 98a-98d pre- 
ss vides an output to OR gate 99. The OR gate 99 provides 
inputs to OR gate 84 and to write control logic 86. The 
write control logic 86 also receives inputs from each 
comparator 90 in the lock register blocks 80a-d0n and 
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each comparator 98a-9Sd asscx:iated with the lock 
queue 130. 

The write control logic 86 provides a LOCK REGIS- 
TER WRITE CONTROL signal to each of the registers 
88 In the lock registers 80a-80n. Further, the write con- s 
trol block 86 provides a LOCK QUEUE REGISTER 
WRITE CONTROL signal to enable the multiplexers 
96a-96d associated with state devices 94a-94d to oper- 
ate in accordance with the lock queue 1 30 design. Also, 
a REFUSAL COUNTER INCREMENT CONTROL sig- io 
nal is provided from write control 86 to a plurality of re- 
fusal counters 131-136. Each refusal counter is associ- 
ated with a node, such as CPU modules 0-3 (Fig. 1) in 
the system. The refusal counters 131-136 are incre- 
mented by signals from the write control 86. Once a par- is 
ticular refusal counter reaches a predetermined limit, an 
END OF COUNT signal is provided to the write control 
86. The predetermined limit in the refusal counter is op- 
timized for the best performance for lock requests in the 
system. The write control 86 further receives from the 
arbiter 51 (Fig. 2) a LOCK CLEAR and LOCK SET sig- 
nal. 

In operation, assuming all of the lock registers 80a- 
80n are available for use, a READ LOCK command and 
an associated memory address to be locked are provid- 2S 
ed in parallel to the comparators 90 in each of the lock 
registers 80a-80n. Each of the respective comparators 
90 compares the address with the address previously 
stored in its associated register 88. In this example, be- 
cause each of the lock registers is initially empty, the 30 
comparators 90 do not generate any matches as an out- 
put to the OR gate 82. Therefore, the output from the 
OR gate 82 provides a LOCK MISS signal to the write 
control 86. The write control 86 then provides a LOCK 
REGISTER WRITE CONTROL signal to registers 88 to 35 
enable a particular one of the registers 68 In the lock 
registers 80a-80n and to set the valid bit. The particular 
block which is enabled by the LOCK REGISTER WRITE 
CONTROL signal is determined by a predefined proto- 
col in the write control 86. By enabling the register 88 40 
with the signal, the READ LOCK command stores its 
associated address In the register 88 from line 89 after 
having been provided as an input thereto from bus 36 
through the delay logic 92. Further the write control 86 
sets the valid bit in register 88 to indicate the memory 4S 
location is locked. The delay logic 92 functions to suffi- 
ciently delay the command and address so as to arrive 
at the register 88 once the write control 86 generates its 
LOCK REGISTER WRITE CONTROL signal, enabling 
storage at a predetermined location. In this manner, up so 
to eight lock addresses can be stored in the lock regis- 
ters 80a-80n. 

- .'.--w*Associat^d with each READ LOCK command is a 
WRITE UNLOCK command and associated address. 
The WRITE UNLOCK command is necessary to unlock ss 

■ the particular memory location once the resource has 
finished its use. Referring back to Fig. 4, WRITEUN- 
LOCK commands are never refused by the lock logic 



71. A WRITE UNLOCK command and associated ad- 
dress on bus 36 provides a LOCK MISS output to the 
write control 86 which provides a LOCK REGISTER 
WRITE CONTROL signal to clear the valid bit in the par- 
ticular register 88 in the lock register block 80a-80n cor- 
responding to the WRITE UNLOCK command. 

Once ail of the lock registers are filled with valid ad- 
dresses of locked locations, as indicated by the lock reg- 
ister valid bit in register 88 (Fig. 4a), then any subse- 
quent lock requests will be refused. Similarly, if a lock 
request is generated for a particular memory location 
which is already locked, then that lock request will also 
be refused. For example, assuming a first READ LOCK 
command was allowed for address 00 in the memory, 
then one of the registers 88 will contain address 00 and 
its lock register valid bit will be set. If a subsequent 
READ LOCK command also desires to access address 
00, then the one comparator 90 associated with the reg- 
ister 88 storing that particular address will generate a 
match signal to OR gate 82. The OR gate 82 thus pro- 
vides a LOCK HIT signal to OR gate 84 which in turn 
outputs a LOCK REFUSED signal to the resource check 
67 in the arbiter. 

Referring back to Fig. 2. the LOCK REFUSED sig- 
nal is provided as an input to the resource check 67 
which enables multiplexer 37b to provide a retry signal 
on the particular E BUS 21-24 from which the READ 
LOCK command was generated. 

Referring back to Fig. 4, when a match is generated 
from one of the comparators 90 in one of the lock reg- 
isters 60a-80n, a signal is sent over line 200 to the write 
control 86. The match indicates that the memory loca- 
tion is currently locked. The write control 86 then pro- 
vides a REFUSAL COUNTER INCREMENT CONTROL 
signal. The REFUSAL COUNTER INCREMENT CON- 
TROL signal enables the particular refusal counter 
1 30-1 36 associated with the node generating the READ 
LOCK command which was refused. This signal incre- 
ments the counter. 

Similarly, when all of the lock registers 80a-80n are 
filled with a valid address and not the address for which 
the lock is requested, then the LOCK MISS signal pro- 
vided from OR gate 82 to the write control 86 will enable 
the REFUSAL COUNTER INCREMENT CONTROL 
signal. This is possible because the write control 86 in- 
ternally tracks the number of valid lock registers and 
therefore knows when the lock registers 80a-80n are 
filled. 

Once a refusal counter 131-136 has been incre- 
mented a predetermined number of times, the END OF 
COUNT signal is provided to the write control 86. This 
generates a LOCK QUEUE REGISTER WRITE CON- 
TROL signal from the writs control 86 to the lock queue- 
130. The node source ID and the lock queue register . 
valid bit (Fig. 4b) are then loaded and set, respectively 
into the top of the queue 94d by enabling the multiplexer 
96d for the particular READ LOCK command and asso- 
ciated address from bus 36. This lock request then be- 
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comes the head of the lock queue 1 30. Once the lock 
queue 130 contains a valid entfy, any subsequent lock 
requests from other nodes will be automatically refused 
(regardless of whether the other conditbns for refusing 
locks are satisfied) and will be stored In the queue 1 30. s 

The LOCK QUEUE REGISTER WRITE CONTROL 
signal can implement several functions. These functions 
include a Hold signal, Update signal and Push To Top 
of Queue signal. These signals are described below with 
respect to the queue 130 operation. 

The LOCK QUEUE REGISTER WRITE CONTROL 
signal is next input to multiplexer 96c which enables the 
second lock request to be stored in location 96c in the 
lock queue 130. If another lock request is generated 
from a node already stored in the k>ck queue 1 30, that 
request will then generate the LOCK QUEUE REGIS- 
TER WRITE CONTROL hold signal that enables the 
middle line of the multiplexers currently storing the same 
entry 94. This new request then is stored in the same 
queue position. 

Each entry in the lock queue 130 is provided as an 
input to its associated comparator 98a-98d. Further, the 
information on bus 36 is also provided to each of the 
comparators 98a-98d. The output from the comparators 
98a-98d are provided as parallel inputs to OR gate 99 
which provides an output both to OR gate 84 (QUEUE 
HIT) and to write control 86. 

The lock queue 130, as shown in Fig. 4, has as 
many entries as there are nodes coupled to the central 
unit 15. As used in the present example, the four entry 
lock queue, i.e., entries 94a-94d, is required because of 
the four possible E BUS nodes from which lock requests 
may originate. Again, as shown in Fig. 4b. each entry in 
the queue 130 is composed of two parts: a valid bit, in- 
dicating whether the entry is valid, and a slot ID which 
points to one of the E BUS CPU nodes. 

Every time the head entry 94d of the lock queue 1 30 
is serviced, i.e., its lock request is satisfied, the lock 
queue Is pushed by the LOCK QUEUE REGISTER 
WRITE CONTROL push to top of queue signal enabling 
the lower input to the multiplexers 96a-96d. This has the 
effect of pushing the entries upward in the queue to cre- 
ate a new head of queue and making available the bot- 
tom entry 94a. For this reason, the kx:k queue 1 30 need 
only be of a depth equal to the number of nodes on the 
E BUS which can generate lock requests. 

An example of the kx:kout avoidance mechanism 
operatbn will now be given. Lock requests are generat- 
ed from the various nodes (Fig. 1 ) in the form of READ 
LOCK commands and an associated address kx:ation 
and are received by the central unit 1 5 through their re- 
spective port logics 49a. The request passes through 
,th%«checJjjJjngn!ogic 66 and into the kxk logic 71 (Fig. 
2) on bus 36. As long as the lock request is not refused 
by the lock logic 71 . the request does not enter the lock 
queue 130 (Fig. 4). However, assuming the lock request 
from node 0, i.e., CPU 0, is refused because the partic- 
ular location in memory has already been locked or be- 



cause no free lock registers 80a-80n are available for 
allocation to the lock request, then the write control 86 
increments the refusal counter 1 31 -1 36 for the particular 
node, in this case CPU 0. After a predetermined period 
of time. CPU 0 again retries its lock request. If the lock 
request from CPU 0 is again refused, its respective re- 
fusal counter is incremented once more. Once a lock 
request has been refused a predetermined consecutive 
number of times while the lock queue 1 30 remains emp- 
ty, the write control 86 then places the identification for 
the particular node at the head of the lock queue 130. 
Only the node ID (Fig. 4b) Is stored in the lock queue 
and not the address of the lock request that was refused. 

Because the lock queue 1 30 is no longer empty, a 
subsequently arbitrated lock request from any other 
node will be refused and will also enter the lock queue 
1 30 in the order in which it is sen/iced by the arbiter 51 . 
Once a lock request from the head of the queue is serv- 
iced, the next waiting lock request in the lock queue 1 30 
is pushed to the head of the queue via the LOCK 
QUEUE REGISTER WRITE CONTROL push to top of 
queue signal and the operation of the multiplexers 96a- 
96d. 

This operation assures that whenever the lock 
queue 1 30 is empty, it is difficult to enter the lock queue 
1 30 because the lock requests from a particular node 
must be refused a predetermined consecutive number 
of times. Therefore, the lock queue 1 30 is predominantly 
kept empty, assuming the refusal counter Is set at a high 
enough value. However, once the lock queue 130 has 
an entry, all future lock requests are serviced strictly by 
their lock queue position, i.e. , the head of the queue gets 
satisfied first, the second entry Is satisfied next, etc. This 
operation continues until the lock queue 1 30 Is again 
empty. 

In sumnr»ry, the lock logic generates a LOCK RE- 
FUSED signaling response to a READ LOCK command 
from a node in three instances: 1) the lock queue is not 
empty and the requesting node is not the head of the 
queue; 2) no free lock registers are available; or 3) the 
particular memory block desired is already locked. 

Because the lock requests are unconditionally 
queued in the lock queue 130 once the lock queue 130 
is no longer empty, the address of the refused lock re- 
quest is not important. So long as each node guarantees 
that it will never lockout any of the multiple sources of 
lock requests it receives, the central unit 15 guarantees 
that every bck request, regardless of its address, has a 
fair and equal chance of entering the lock queue 130 
and hence, eventually reaching the head of the kx:k 
queue 130 for servicing. 

The above description guarantees that no lockout 
will occur at the highest level in the systorr.. Hcwevof, -^-r - 
to guarantee that lockouts do not occur anywhere in the 
system, lockout avoidance mechanisms must be in 
place wherever multiple sources of lock requests are 
generated. Thus, while the central unit 15 avoids lock- 
outs for each of the nodes, i.e., the CPUs coupled there- 
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to, via lock logic 71, a lockout avoidance mechanism is 
necessary in each node to avoid lockouts of other sourc- 
es of lock requests. 

Referring again to Fig. 3, the CPU block diagram 
includes the CP chip 100 which has a lock logic 125. 
This lock logic 125 prevents lockouts of either the proc- 
essor chip's 104 or X chip's 102 lock requests. The lock 
logic 125 operates similarly to the lock logic 71 shown 
in Fig. 2. Because the lock queue 130 in the central unit 
15 does not store addresses nor whether the lock re- 
quest was from either the X chip or the processor chip 
104. it is possible that either the processor chip or the 
X chip can lock the other out from ever having their lock 
request satisfied. 

Fig. 5 illustrates the two entry queue used in the lock 
logic 1 25 of the CF chip 1 00. In this example, the queue 
134 includes two entries, each of which includes two 
bits: 1) an entry valid bit; and 2) a source ID bit, e.g.. X 
chip or processor chip. 

In operation, as bng as a lock request from the 
processor chip or X chip is not refused by the central 
unit 15, the queue 134 remains empty. However, once 
a lock request from, for example, the processor chip, is 
refused by the central unit 15, the lock request immedi- 
ately enters the head of the queue 1 34. From this point 
onward, only the processor chip can have its lock re- 
quests forwarded onto the E BUS (and hence to the cen- 
tral unit 1 5) from the CF chip 100. If, for example, the X 
chip requests a lock, this request will enter the queue 
134 behind the processor chip's entry. Further, the X 
chip's lock requests will intemally be refused by the CF 
chip 100 and thus prevented from going onto the E BUS. 

Once the head of the queue, in this example the 
processor chip entry, is eventually satisfied by the cen- 
tral unit 1 5, it is popped out of the queue 1 34 and the X 
chip's lock request becomes the new head of the queue 
134. 

The method used in the CF chip 100 for avoiding 
lockouts is as follows. If the queue 1 34 is empty, both 
the processor and X chip can send their respective lock 
requests to the central unit 1 5 via the E BUS 1 7-20. If a 
lock request is refused by the central unit 15, then the 
source of the lock request, Le.. processor or X chip, 
along with whether it is valid or invalid, is entered into 
the queue 134. It is important to note that if the source 
is already stored in the queue, it will maintain its queue 
position. 

The protocol used in the CF chip to avoid lockouts 
is essentially similar to the bck queue 1 30 used in the 
central unit. However, in this instance there is no need 
to implement a refusal counter in the CF chip 100, be- 
cause the frequency at which lock requests are gener- 
u-ated *foralh^Xchip^t the CPU level is not great enough 
to require the use of a refusal counter. 



Claims 

1. A method for avoiding lockout of lock requests for 
a shared resource, generated from a plurality of 
s nodes coupled to a central location, the method 
comprising the steps of: 

incrementing a counter associated with a par- 
ticular one of the nodes when a lock request 
10 from said particular node is refused in the cen- 

tral location; 

generating an end of count signal from said 
counter when the lock request is refused a pre- 
determined number of times; 
IS storing the lock request as a head entry in a 

queue once the end of count signal in generat- 
ed; 

subsequently storing any further lock requests 
from any other of the nodes at the tail of the 
20 queue as further entries in sakJ queue once the 

queue contains a head entry; and 
operating said queue to the entries in the order 
in which they are placed in the queue. 

2S 2. A method according to claim 1 , wherein the step of 
storing the lock request comprises generating a first: 
signal to enable a first register in said queue to store 
the lock request. 

30 3. A method according to claim 2, wherein the step of 
subsequently storing comprises generating a sec- 
ond signal to enable a next register in said queue 
to store the next lock request from a different node. 

35 4. A method according to claim 3, wherein the step of 
operating the queue comprises: 

generating a third signal to push said queue 
once the head entry is serviced such that the 
40 next entry in the queue becomes the head en- 

try; and 

continuing to generate the third signal each 
time the head entry is serviced until the queue 
is empty. 

45 

5. A lockout avoidance circuit for a plurality of nodes 
coupled to a central kx:ation and generating k)ck re- 
quests for a shared resource, comprising: 

so a lock queue having a head and tail; 

means for counting lock requests that have 
been refused from at least one of those nodes; 
means for enabling the queue to store a icck 
request from the node at the head of the queue 

ss after a predetermined number of lock requests 

from the node have been refused, and storing 
all subsequent lock requests from any other of 
the nodes at the tail of the queue in the order 
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In the order In which they are requested; and 
means for enabling operating the queue to ad- 
vance the stored lock requests from the tail end 
of the queue toward the head of the queue each 
time the lock request at the head of the queue 
is serviced. 

6. A circuit according to claim 5,lncluding a control cir- 
cuit coupled to the lock queue, wherein the lock 
queue includes a plurality of queue registers each 
having a storage device and wherein the plurality of 
queue registers provide either a lock refused or lock 
miss signal in response to a lock request; and 

the lock miss signal being forwarded to the 
control circuit to activate the first signal for storing 
the lock request. 

7. A circuit according to claim 5 wherein said lock 
queue includes a plurality of queue registers and 
further comprises; 

a plurality of multiplexers, one of the multiplex- 
ers being associated with each one of the 
queue registers, said multiplexers receiving a 
second signal for operating the kx:k queue. 

8. A circuit according to claim 6 wherein the lock re- 
fused signal enables the control circuit to generate 
a third signal to the respective counter associated 
with the node generating the k>ck request. 

9. A circuit according to claim 6, wherein each queue 
register comprises: 

a valid indication field; and 
a node source ID field. 

10. A circuit according to claim 9 wherein each storage 
device includes: 

an address field; 

a node source ID field; and 

a valid indicator. 



Patentanspruche 

1. Verfahren zum Vermeiden der Aussperrung von 
Verriegelungsanforderungen fOr ein gemeinsam 
genutztes Betriebsmittel, die von mehreren Knoten 
erzeugt werden, die an eine zentrale Einrichtung 
gekoppelt sind, wobei das Verfahren die folgenden 

. .SchrittejepthpJt: . . 

Inkrementieren eines einem besonderen der 
Knoten zugeordneten Zahlers, wenn eIne Ver- 
riegelungsanforderung von diesem besonde- 
ren Knoten in der zentralen Einrichtung abge- 



wiesen wird; 

Erzeugen eines Zahlendesignals vom Zahler, 
wenn die Verriegelungsanforderung In einer 
vorgegebenen Anzahl abgewiesen worden ist; 

s Speichern der Verriegelungsanforderung als 

einen Kopfeintrag in einer Warteschlange, so- 
bald das Zahlendesignal erzeugt worden ist; 
anschlieOend Speichern irgendwelcher weite- 
rer Verriegelungsanforderungen von irgend- 

10 welchen anderen der Knoten am hinteren Ende 

der Warteschlange als weltere Eintrage in der 
Warteschlange. sobald die Warteschlange ei- 
nen Kopfeintrag enthalt; und 
Bearbeiten der Eintrage der Warteschlange in 

IS der Reihenfolge. in der sie in der Warteschlan- 

ge gesetzt werden. 

2. Verfahren nach Anspruch 1 , bei dem der Schritt des 
Speicherns der Verriegelungsanforderung das Er- 
20 zeugen eines ersten Signals enthalt, mit dem ein 
erstes Register in der Warteschlange freigegeben 
wird. um die Verriegelungsanforderung zu spei- 
chern. 

2S 3. Verfahren nach Anspruch 2, bei dem der Schritt des 
nachfolgenden Speicherns das Erzeugen eines 
zweiten Signals enthalt, mit dem ein nachstes Re- 
gister in der Warteschlange freigegeben wird, um 
die nachste Verriegelungsanforderung von einem 

30 anderen Knoten zu speichern. 

4. Verfahren nach Anspruch 3, bei dem der Schritt des 
Bearbeitens der Warteschlange enthalt: 

35 Erzeugen eines dritten Signals, um die Warte- 

schlange zu verschieben, sobald der Kopfein- 
trag bedient worden ist. so daB der nachste Ein- 
trag in der Warteschlange zum Kopfeintrag 

wird; und 

40 fortgesetztes Erzeugen des dritten Signals je- 

desmal, wenn der Kopfeintrag bedient wird, bis 
die Warteschlange leer ist. 

5. Aussperrungsvermeidungsschaltung fur mehrere 
45 Knoten, die an eine zentrale Einrichtung gekoppelt 

sind und Verriegelungsanforderungen fur ein ge- 
meinsam genutztes Betriebsmittel erzeugen, mit: 

einer Verriegelungswarteschlange mit einem 
so vorderen Ende und einem hinteren Ende; 

einer Einrichtung zum Zahlen von abgewiese- 
nen Verriegelungsanforderungen von wenig- 
stens einem dieser Knoten; 
einer Einrichtung zum Freigeben der Warte- 
55 schlange, um eine Verriegelungsanforderung 

von dem Knoten am vorderen Ende der Warte- 
schlange zu speichern, nachdem Verriege- 
lungsanforderungen in einer vorgegebenen 
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Anzahl von dem Knoten abgewiesen worden 
ist, und zum Speichern aller nachfolgenden 
Verriegelungsanforderungen von irgendwel- 
chen anderen der Knoten am hinteren Ende der 
Warteschiange in der Reihenfolge. in der sie 
angefordert werden; und 
einer Einrichtung zum Freigeben der Bearbei- 
tung der Warteschiange, um jedesmal, wenn 
die Verriegelungsanforderung am vorderen En- 
de der Wartesclilange bedient worden ist. die 
gespeicherten Verriegelungsanforderungen 
vom hinteren Ende der Warteschiange zum 
vorderen Ende der Warteschiange vorzuschie- 
ben. 

6. Schallung nach Anspruch 5, die eine mit der Ver- 
riegelungswarteschlange gekoppelte Steuerschal- 
tung enthalt, wobei die Verriegelungswarteschtan- 
ge mehrere Verriegelungsregister enthalt. wovon 
jedes eine Speichervorrichtung besitzt, und wobei 
die mehreren Warteschlangenregister als Antwort 
auf eine Verriegelungsanforderung jeweils entwe- 
der ein Signal fur abgewiesene Verriegelung Oder 
ein Signal fur fehiende Verriegelung erzeugen; und 

das Signal fur fehiende Verriegelung an die 
Steuerschaltung geschlckt wird, um das erste Si- 
gnal zum Speichern der Verriegelungsanforderung 
zu aktivieren. 

7. Schaltung nach Anspruch 5, bei der die Warte- 
schiange mehrere Warteschlangenregister enthalt 
und die ferner enthalt: 

mehrere f^uttiplexer, wobei jedem der Warte- 
schlangenregister einer der Multiplexer zugeordnet 
ist, wobei die Multiplexer ein zweites Signal zum 
Bearbeiten der Verriegelungswarteschlange emp- 
fangen. 

8. Schaltung nach Anspruch 6, bei der das Signal fur 
abgewiesene Verriegelung die Steuerschaltung 
freigibt. damit sie ein drittes Signal fur den jeweili- 
gen Zahler erzeugt, der dem die Verriegelungsan- 
forderung erzeugenden Knoten zugeordnet Ist 

9. Schaltung nach Anspruch 6, bei der jedes Warte- 
schlangenregister enthalt: 

ein GQttigkeitsanzeigerfeld; und 
ein Quellknoten-1D-Feld; 

10. Schaltung nach Anspruch 9, bei der jede Speicher- 
vorrk;htung enthalt: 

ein Adressenfeld; 

ein Quellknoten-ID-Feld; und 

einen Gultigkeitsanzeiger. 



Revendications 

1. Procede pour eviter I'interdiction d'acc^s pour des 
demandes de verrouillage d'une ressource parta- 
g^e, g6n6r6s ^ partir d'une multiplicity de noeuds 
couples ^ un emplacement central, le proc6d6 com- 
portant les stapes consistant: 

k incrementer un compteur associe a un noeud 
particulierparmi les noeuds lorsqu'une deman- 
de de verrouillage en provenance dudit noeud 
particulier est rejet6e dans Templacement cen- 
tral; 

d g^n^rer un signal de fin de comptage k partir 
dudit compteur lorsque ladite demande de ver- 
rouillage a §X6 rejet6e un nombre pr^ddtenTiind 

de fois; 

6 emmagasiner la demande de verrouillage en 
tant qu'entr^e de t§te dans une file d'attente 
une fois que le signal de fin de comptage a dtd 
g^nere; 

a emmagasiner subsequemment toutes autres 
demandes de verrouillage dmanant de n'impor- 
te lesquels des autres noeuds en queue de la 
file d'attente en tant que d'autres entrees de la- 
dite file d'attente une fois que la file d'attente 
contient une entree de tdte; et 
& commander ladite file d'attente par rapport 
aux entries suivant I'ordre de leur placement 
dans la file d'attente. 

2. Proc^y selon la revendtcatbn 1 . dans lequel I'dta- 

pe de stockage de la demande de verrouillage con- 
siste ^ generer un premier signal pour autoriser un 
premier registre de ladite file d'attente k emmaga- 
siner la demande de verrouillage. 

3. Procdde selon la revendication 2, dans lequel I'^ta- 
pe de stockaga subsequent consiste k g6n6rer un 
second signal pour autoriser un registre suivant de 
ladite file d'attente k emmagasiner la demande de 
verrouillage suivante en provenance d'un autre 
noeud. 

4. Proc6d6 selon la revendication 3, dans lequel r6ta- 
pe de commande de la file d'attente consiste: 

k g^ndrer un troisi^me signal pour pousser la- 
dite file d'attente une fois que I'entr^e de tdte a 

6t6 prise en charge de sorte que TentrSe sui- 
vante de la file d'attente devienne Tentr^e de 
tdte; et 

k continuer k g^n^rer le troisi^me signal cha- 
que fois que Centrde de t§te est prise en charge, 
jusqu'd ce que la file d'attente soit vide. 

5. Circuit pour Eviter les interdictions d'acc^s pr^vu 
pour une multiplicity de noeuds couples k un em- 



10 



IS 



20 



25 



30 



35 



40 



45 



SO 



10 



19 



EP0 464 715 B1 



20 



placement centra! et generant des dennandes de 
verrouiliage d'une ressource partag^e, comportant: 

une file d'attente de verrouiliage ayant une t§te 
et une queue; ^ 
des moyens pour connpter les demandes de 
verrouiliage qui ont 6\6 rejet6es 6manant d'au 
moins un desdits rioeuds; 
des naoyens pour autoriser la file d'attente k 
emmagasiner une dennande de verrouiliage en io 
provenance du noeud k la tete de la file d'at- 
tente apres qu'un nombre predetermine de de- 
mandes de verrouiliage en provenance du 
noeud ont 6t6 rejet6es, et pour emmagasiner 
toutes les demandes de verrouiliage subs^- is 
quentes en provenance de n'importe quel autre 
des noeuds en queue de la file d'attente suivant 
rordre dans lequet elles sont faites; et 
des moyens pour permettre de commander la 
file d'attente de fa^ k avancer les demandes 20 
de verrouiliage emmagasinees depuis I'extre- 
mtte queue de la file d'attente vers ta tdte de ia 
file d'attente chaque fois que la demande de 
verrouiliage se trouvant en tete de la file d'at- 
tente est prise en charge. 



registre de file d'attente comprend: 

une zone d'indication de validity: et 

une zone d' identification de source de noeud. 

10. Circuit selon la revendication 9, dans lequet chaque 
dispositif de stockage comprend: 

une zone d'adresse: 

une zone d'identification de source de noeud; 
et 

un indicateur de validite. 



6. Circuit selon ta revendication 5, comprenant un cir- 
cuit de commande couple k la file d'attente de ver- 
rouiliage, dans lequel la file d'attente de verrouiliage 
comprend une muftiplicite de registres de file d'at- 30 
tente ayant chacun un dispositif de stockage, et 
dans lequel ta multipllcrte de registres de file d'at- 
tente fournissent soit un signai de refus de ver- 
rouiliage, soit un signal de non correspondance de 
verrouiliage en reponse k une demande de ver- 3S 
rouillage; et 

le signal de non correspondance de ver- 
rouiliage est achemine vers le circuit de commande 
pour activer le premier signal pour emmagasiner la 
demande de verrouiliage. ^0 



7. Circuit selon la revendication 5, dans lequel ladite 
file d'attente de verrouiliage comprend une multipli- 
city de files d'attente de registres et compoite. en 
outre: <5 

une multiplicite de muttiplexeurs, I'un des mul- 
tiplexeurs etant associe k chacun des registres de 
file d'attente, lesdits multiplexeurs recevant un se- 
cond signal pour commander la file d'attente de ver- 
rouiliage. so 

8. Circuit selon la revendication 6, dans lequel le si- 
gnal de refus de verrouiliage autori^e !e circuit de 
commande h g^n^rer un troisi^me signal k destina- 
tion du compteur respectif associ6 au noeud g6ne- ss 
rant la demande. de verrouiliage. 



9. Circuit selon la revendication 6, dans lequel chaque 
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